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Combining an analytical and numerical approach we investigate the dispersion of the topologically 
protected spin-filtered edge-states of the Quantum Spin Hall state on honeycomb and ruby nets with 
zigzag (ZZ) and armchair (AC) edges. We show that the Fermi velocity of the helical edge-states 
on ZZ edges increases linearly with the strength of the spin-orbit coupling (SOC) whereas for AC 
edges the Fermi velocity is independent of the SOC. Also the decay length of edge states into the 
bulk is dramatically different for AC and ZZ edges, displaying an inverse functional dependence on 
the SOC. 
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Introduction - In their seminal paper [IJ, Kane and 
Mele have shown that spin orbit coupling (SOC) in a 
single plane of graphene leads to a time-reversal invariant 
Quantum Spin Hall (QSH) state that is characterized by 
a bulk energy gap and a pair of topologically protected 
gapless edge-states. However, the SOC energy scale in 
graphene is so tiny that the predicted gap [5] is merely ~ 
Q.QIK . It is therefore not possible in practice to establish 
the existence of the underlying Z2 topological order in 
graphene [3H5] so that the hunt for the QSH effect was 
continued in other materials. The theoretical prediction 
and experimental observation [7] of the QSH effect 
in HgTe thin films have firmly categorized this material 
as the sought-after two-dimensional (2D) Z2 topological 
insulator (TI) . Having a zinc-blende crystal structure this 
material is of course very different from graphene from 
both an electronic and a structural point of view. 

The recently discovered topological insulator 
Bii4Rh3lg, however, provides an entirely novel platform 
for the observation of the QSH effect in graphene-like 
systems with a honeycomb structure [S]. Bii4Rh3lg 
consists of stacks of bismuth-based layers each of which 
forms a honeycomb net composed of RhBig cubes. 
These cubes form what is commonly referred to as a 
ruby lattice, see Fig. [T] which has the same point group 
symmetry as the hexagonal graphene honeycomb lattice. 
Each such a layer of Bii4Rh3l9 forms a 2D Z2 TI, with 
a large spin-orbit gap of ~ due to the strong 

bismuth- related SOC [5]. The gap being six order of 
magnitudes larger than graphene opens the avenue for 
the actual observation of the QSH effect in a hexagonal 
graphene-like system. 

For a future use of this QSH effect a fundamental un- 
derstanding of the topologically-protected spin-polarized 
edge-states is essential. We have therefore investigated 
the electronic characteristics of these topological edge- 
states in both honeycomb and ruby lattices in the pres- 
ence of SOC. We find in these hexagonal systems a dra- 
matic dependence of the edge-state dispersion, decay 
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FIG. 1: (Color online) Lattice structure of honeycomb (blue) 
and ruby nets (black). The primitive lattice vectors are ai 
and sl2- The nearest-neighbor hopping is t (to, t\) and the 
SOC strength tso (^2, ts) for the honeycomb (ruby) lattice. 
Top and bottom are zigzag (ZZ) edges and left and right are 
armchair (AC) edges. The width of the ribbons as a 
function of the number of atoms in the unit cell A*' is indicated 
by W. 



length and Fermi velocity on the edge geometry. While 
for a zigzag (ZZ) termination the Fermi velocity of the 
edge-states critically depends on the size of the spin-orbit 
gap, armchair (AC) edge-states exhibit a linear disper- 
sion with a velocity that is independent of strength of the 
SOC. We show that indeed in simple honeycomb nets 
the Fermi velocity of AC-edges corresponds exactly to 
the Fermi velocity of the bulk massless Dirac fermions 
in absence of SOC. Surprisingly, we find that the edge- 
state decay lengths at ZZ- and AC-edges depend on the 
SOC strength in an opposite manner: while the first one 
grows with the SOC, the other shrinks. This empha- 
sizes the fundamentally different electronic properties of 
Quantum Spin Hall edge-states at zig-zag and armchair 
terminations of hexagonal lattices. 
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Model - We start from the well-known tight-binding 
Hamiltonian for graphene that includes the effect of the 
SOC via a next-nearest-neighbor hopping [J, 

H = 4a'^j^ + itso ^«J'5a/3cLcj73, (1) 

(y)cr {{ij))al3 

where c|^^ and Cic are, respectively, creation and anni- 
hilation operators of an electron on site i with spin a. 
The first term corresponds to nearest neighbor hopping 
interaction, whereas the second term connects second 
neighbors with a spin dependent amplitude. The quan- 
tity fij=+l(— 1) if the electrons makes a left (right) turn 
on the lattice during the second-neighbor hopping. As 
indicated in Fig. [l} t is the nearest-neighbor hopping pa- 
rameter and tgo is the second nearest-neighbor param- 
eter within the two-dimensional honeycomb sheet, and 
parametrizes the strength of the SOC. 

In the Bi-Rh sheets of Bii4Rh3l9 the Bi atoms form a 
two-dimensional ruby lattice that can be thought of as 
a decorated honeycomb net as shown in Fig. [T] The 
resulting ruby lattice, as the honeycomb one, belongs 
to the group of 11 Archimedean lattices, which repre- 
sent the prototypes of two-dimensional arrangements of 
regular polygons [3]. It has a geometric unit cell with 
6-sites and an underlying triangular Bravais lattice con- 
taining two non-equivalent nearest-neighbor bonds. The 
first Brillouin zone is analogue to the one for the honey- 
comb lattice, with high symmetry points F, M and K. 
The nearest-neighbor hopping parameters are denoted by 

and ti, and the second nearest- neighbor parameters 
by t2 and t^. For simplicity we consider the symmetric 
case to=ti=t and t2=tz=tso- The real-space triangu- 
lar Bravais vectors of both lattices are ai=a(l/2, -^3/2), 
a2=a(— 1/2, -\/3/2), and the reciprocal lattice basis vec- 
tors are bi=27r(l, l/-\/3)/a and b2=27r(— 1, l/\/2>)/a. 

Diagonalizing the Hamiltonian ([T]) results in the bulk 
energy bands for the honeycomb and ruby nets as shown 
m Fig. [2| The Cq^ point group symmetry shared by both 
lattices leads to the presence of massless Dirac fermions 
at the inequivalent K and K' points of the Brillouin zone 
when the strength of the SOC vanishes. For the ruby lat- 
tice, the Dirac points at the K (K') point appears only for 
1 /6 and 4/6 filling of the bands whereas a quadratic band 
touching point at F for 3/6 and 5/6 fillings is observed. 
The degeneracy at the Dirac points is lifted by the SOC 
driving the system into a topologically non-trivial QSH 
phase. For the honeycomb lattice the presence of topo- 
logical order does not depend on the SOC strength [J - 
the role of the SOC is to ensure a finite gap everywhere in 
the Brillouin zone. On the contrary, for honeycomb ruby 
nets a direct computation of the Z2 topological invariant 
shows that a topologically non-trivial QSH phase is sta- 
bilized for definite sets of tight-binding parameters. For 
the above-mentioned symmetric choice the QSH phase 
occurs both at 4/6 and 1/6 fillings for < tso/t < 0.29: 
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FIG. 2: Bulk energy bands for the honeycomb and the ruby 
lattices without (a), (c) and with (b), (d) SOC. Energies are 
measured in units of the nearest-neightbor hopping t. SOC 
is introduced via tso ~ O.lt. Note that for both lattices, 
there is a Dirac point at K in absence of SOC, opening a gap 
once this hopping is switched on. This gap opens at different 
fillings of the bands for the ruby lattice (1/6 and 4/6) and at 
1/2 filling for the honeycomb case. 



at tso/t — 0.29 one finds a topological phase transition 
to a trivial band insulator at 4/6 filling |10j . 

In order to characterize the properties of the 
topologically-protcctcd edge-states in the QSH phase on 
honeycomb and ruby nets we consider ribbons of the two 
lattices with different terminations as shown in Fig. [T] In 
perfect analogy with the honeycomb lattice the ruby lat- 
tice also exhibits ZZ and AC edge terminations. The 
ensuing dispersions of the ribbons are summarized in 
Fig. [Sj For honeycomb ribbons edge states appear inside 
the bulk spin-orbit gap at half-filling. For the ruby lat- 
tice, we observe edge-states for 1/6, 4/6 and 5/6 fillings in 
agreement with the calculated Z2 topological invariant. 

Fermi velocity at ZZ edges - The geometry of ZZ 
nanoribbons is shown in Fig. [l] where the edge runs along 
X-axis, so that the system is translational invariant along 
this direction. The corresponding wavefunctions exist in 
the space < ?; < W. In the absence of SOC, the band 
structure of the zigzag terminated ribbons exhibits four- 
fold degenerate (2 spins times 2 edges) edge-localized 
states at zero energy in the honeycomb lattice [HI [12] , 
appearing in perfect analogy at 4/6 and 1/6 fillings in 
the ruby net [see the Supplemental Material] where close 
to the Fermi energy a Dirac point in the bulk band struc- 
ture occurs. These edge states connect momenta of the 
ID Brillouin zone corresponding precisely to the projec- 
tions of the K and K' points of the bulk 2D Brillouin 
zone. Indeed we find that these states connect the two 
momenta Kx=2Tr/{3a) and K'^=—2tt / {3a) to the edge of 
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the ID Brillouin zone for honeycomb terminated ribbons 
as well as ruby ribbons at 1/6 filling - in which case the 
edge states form almost flat bands - whereas at 4/6 filling 
more dispersive edge states of the ruby ribbons intercon- 
nect Kx to K'^. 

When the SOC is introduced via tso helical edge states 
lying in the bulk spin-orbit gap appear. At the ZZ edges 
their corresponding Fermi velocity increases linearly with 
the strength of the SOC. This is explicitly shown in 
Fig. |4|^a) where we plot the Fermi velocity vp the hon- 
eycomb and ruby ZZ edge-states as a function of the SOC 
tso- For honeycomb and ruby ZZ terminated ribbons at 
1 /6 filling the linear dependence of vp on tso can be esti- 
mated by the ratio of the spin-orbit gap and the distance 
between K^; and K'^ points [IS] (see Fig. |3|. Therefore, 
vp = Aso/^KK', where Akk' = 2n/{3a). Calculat- 
ing the velocity as a function of the bare Fermi velocity 
vpo of the massless bulk Dirac fermions in the absence 
of SOC while taking into account the dependence of the 
gap Aso on tso, we obtain 
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(2) 



where for the honeycomb lattice an — IS/tt as it fol- 
lows immediately considering that vpo = y/3ta/2 and 
Aso — (iV^tso, whereas for the ZZ edge states of ruby 
ribbons at 1/6 filling an = 4.808/7r. These analytical 
results [c.f. the dashed lines in Fig. |4ja)] are in excellent 
agreement with the numerical ones. The edge states of 
ZZ terminated ruby ribbons at 4/6 filling show instead a 
more complicated functional dependence on the momen- 
tum: we observe that terms up to are comparable in 
magnitude with the Fermi velocity even if the resulting 
Vp is remarkably close to the Fermi velocity of the 1/6 
filling edge states, see Fig. Qa). 

Fermi velocity at AC edges ~ Having established the 
linear dependence of the Fermi velocity of the edge-states 
in ZZ terminated ribbons on the SOC, we now turn to 
discuss the properties of the edge-states in AC termi- 
nated ribbons. In the case of an AC termination, as 
shown in Fig. [l] the edge is parallel to y-axis, and the 
wavef unctions exist in the space < x < W^. The two 
Dirac points are projected onto the time-reversal invari- 
ant point fcj, = of the ID Brillouin zone where the edge 
states form a Kramer's doublet. As a result, their disper- 
sion away but close to fcy = can be analysed in the k.p 
approximation [TTJ [TH [TS] once SOC is explicitly taken 
into account. 

To this end, we consider the effective Dirac equation [Ij 
for the states near the K and K' points of the hexagonal 
Brillouin zone of the honeycomb lattice 



U = vpo (r^a^kx 



sVst 
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(3) 



acting on a two-component spinorial wavefunction. In 
the equation above, the cr's are Pauli matrices with 
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FIG. 3: (Color online) Energy bands for honeycomb and ruby 
ZZ (a),(c), and AC (b),(d) terminated ribbons in presence of 
SOC . Energies are measured in units of the nearest-neightbor 
hopping amplitude, t, and the SOC effects are introduced via 
tso ~ 0-lt. The blue bands correspond to the edge-states 
crossing the gap, at 1/2 filling for honeycomb and for the 
ruby lattice at 1/6, 4/6 and 5/6 fillings. 



Tz ~ ± for states at the K (K') points, Sz represent- 
ing the electron's spin and cr^ = ± describing states on 
the A {B) sublattice (see Fig.[l]). To find the wave func- 
tion for the ribbon with AC edges we replace kx — > —idx 
in the Hamiltonian above [TT]. The general solution is 
found by using the ansatz for the spinorial wave func- 
tion -ij)^' [x) = XtI ^^'^ ■ ^ I'sal value of A yields evanes- 
cent waves corresponding to the edge-states. The wave- 
functions Tp have to meet the boundary condition at the 
armchair edges. For the honeycomb lattice, the correct 
boundary condition can be found by considering that the 
armchair termination consists of a line oi A~ B dimers 
at a; = and x = W + a/2. To do this, we admix 
valleys [TT] and require 1p'!^^{x = 0) = tpt^{x = 0) and 



^^_^'(x = W + a/2) = ^'J{x = W + a/2)e'^^^^+''/'^\ 
where AK — 47r/(3a). For ribbons whose width {W + 
a/2)AK = 27rn with n integer - a condition which, in 
the absence of SOC, leads to a zero energy mode pT] - 
we obtain two solutions for the energy near the K(K') 

±kyVp and 62 



point: El — ±kyVp and 62 ~ ±^ k'^Vp -\- 27tgQ. The 

first one corresponds to edge states lying in the bulk 
spin-orbit gap in which case A = 3y/3tso/vp, and the 
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FIG. 4: (Color online) (a),(b): Fermi velocity of the edge 
states in units of the Fermi velocity of the bulk Dirac fermions 
as a function of the spin-orbit coupling, tso, for honeycomb 
and ruby zigzag (a) and armchair (b) ribbons, (c), (d): In- 
verse decay length A for zigzag (c) and armchair (d) ribbons 
as a function of the SOC. Depending on the edge geometry 
A decreases (c) or increases (d) with tso- The dashed lines 
represent the analytical results. 



second energy is the one describing the bulk bands as 
in this case A = 0. As a result, the Fermi velocity of 
the AC edge-states is independent on the strength of the 
SOC and corresponds to the bare Fermi velocity of the 
Dirac fermions, in perfect analogy with semi- infinite AC- 
terminated ribbons [16t.l7J . As shown in Fig. |4]we find a 
perfect agreement with the tight-binding calculations on 
honeycomb armchair-terminated ribbons and, quite re- 
markably that for the ruby lattice vp is also independent 
of tso s-s well. 

Decay length of edge states - The dependence of the 
Fermi velocity on the strength of the SOC being com- 
pletely different for ZZ and AC edges, raises the question 
how different other electronic properties of the ZZ and 
AC edge states are. Via the analytical results we have 
access to the dependence of the edge-states on AC rib- 
bon width, from which one can obtain how far the edge 
states penetrate into the bulk of the systems. This de- 
cay length is inversely proportional to A, which we ob- 
tain numerically by analyzing the energy gap A at the 
ID time-reversal invariant point. This gap results from 
the hybridisation of the edge states localised at opposite 
edges and its behavior as a function of the ribbon width 
W is Aq e~'^^ [see the Supplemental material]. For the 



case of the armchair ribbon, as discussed above, we find 
that the inverse decay length A = i^/itso/vF- As shown 
in Fig. |4]i, the numerical results show that A increases 
linearly with the SOC for AC terminations of both the 
honeycomb and ruby lattices, in excellent agreement with 
the analytical calculation (dashed line). 

To obtain analytically the edge state decay length in 
ZZ ribbons, we solve the full tight-binding Hamiltonian 
at the ID time-reversal invariant point fej, = tt in a semi- 
infinite ribbon < y < oo with open boundary conditions 
[18j . Here we use the fc-dependence of the Hamiltonian |3] 
given by F(k) = do(k)I + ELi c^a(k)^^ where ah da(k) 
are zero except, (ii(k) = t\\ + cos(k • ai) -I- cos(k • 32)], 
c?2(k) = <[sin(k-ai)-|-sin(k-a2)], and (i5(k) = 2i5o[sin(k- 
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sin(k 



a2j - 
and 



- sin(k • ai 



k • aa)], ri = «) I, 
^ . With the ansatz for 
Ay 



the four-component spinorial wave function ip = xe 
we obtain the secular equation for the zero-energy edge 
doublet in ZZ ribbons 



Det 



At so cosh(^A) X F^ t X 







(4) 



As a result, the inverse decay length at ZZ edges de- 
pends on the SOC as ^=-^ ^ (l^f^ ) • quite re- 
markable that where the decay length of the edge states 
at the AC edge is inversely proportional to the SOC, at 
the ZZ edge it is proportional to it. The analytical ex- 
pression is compared to the numerical results for the hon- 
eycomb lattice in Fig.|4]jc), showing excellent agreement. 
The calculated decay length for the ruby ribbon at 4/6 
filling follows a very similar trend. Remarkably the ruby 
ribbon at 1 /6 filling shows almost no dependence on the 
SOC. 

Conclusions - Using a combined analytical and numer- 
ical approach we have shown that zigzag and armchair 
edges of honeycomb and ruby QSH nets carry funda- 
mentally different topological edge-states: the dispersion, 
velocity and decay length of the edge-states, and their de- 
pendence on the spin-orbit coupling strength differ. For 
the ruby net there is in addition a combined filling and 
edge-termination dependence. Particularly the termina- 
tion dependent decay length that we have established 
here theoretically provides an interesting and testable 
prediction for Bii4Rh3l9 [5]. In this material the topo- 
logical edge-states are in principle directly accessible by 
Scanning Tunneling Microscopy at surface step-edges, as 
the spin-orbit gap in the QSH layers of this TI material 
is quite substantial. 

The authors thanks M. Richter, M. Ruck, and J.W.F. 
Venderbos for helpful discussions. 
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